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Problem  Statement 
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•  USSTRATCOM  has  requested  assistanee  assigning 
sensors  to  multi-stage  missions 

•  Each  mission  has  several  stages,  and  some  sensors  may  be 
shared  between  missions 

•  Each  sensor  has  a  distinct  probability  of  success  at  a 
unique  mission’s  stage 

-  These  probabilities  are  not  always  known  until  just  prior  to  tasking 


Stage  1  Stage  2  Stage  3  Stage  4 


Problem  Example 


Set  of  missions 


Stage  1  Stage  2  Stage  3  Stage  4 


Mh^ion 

Complete 


Stage  1  Stage  2  Stage  3  Stage  4 


\ih^ior\ 

St€trt 


Mh^iQn 

Complete 


Stage  1  Stage  2  Stage  3  Stage  4 


Start 


Mh^iQn 

Complete 


Stage  1  Stage  2  Stage  3  Stage  4 
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Mh^ion 

Complete 
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General  Mathematical  Description^ 
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maxF(x), 


X  e  B 


n 


F(x)  G 
•  This  research  seeks  to 

-Define  X  G  B^,  XG^^  ,  and  F(x) 
-  Find  techniques  to  Maximize  F(x) 
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Reliability  Theory 


R=[l-{1-  P{En)){l  -  P{E2imP{Eu)] 


•  Basic  bridge  structure  network 

-  Assuming  independent  failures  of  elements, 
calculations  are  simple 
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Reliability  Theory 


771  /  71 

^=n  1-11(1 

j=i  \  i=i 


•  General  bridge  network 

-  System  is  called  a  series-parallel  redundant  system 
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Simple  Resource  Allocation 


max^ 

j=i 


^  Xj  <  I) 

i=i 

X  G  Z” 

•  fj{Xj)  is  concave,  increasing,  and  non-linear 

•  Problem  is  NP-Complete 
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Weighted  Sum  Scalarization 


max 


P 

k^l 


X  e  B” 


/(x)  G  M 

•  Converts  a  multi-objective  function  into  a 
single  objective  function 

•  Answers  are  guaranteed  to  be  efficient 
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Methodology 

Air-  fDPiQC  INhTITuIC  cflF  TECNMLDGt 

•  Formulation  of  Maximum  Utility  Sensor 
Assignment  Problem  (MUSAP)  as  an  IP 

•  Solution  techniques 

-  Explicit  enumeration 

-  Heuristics  (Simulated  Annealing) 
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Model  Formulation 
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1 

0 


31’ wise. 


•  Decision  Variables 

-  Current  formulation  assumes  any  sensor  can  do 
any  mission  at  any  stage 

-  Each  assignment  has  a  probability  of  success,  Pijk 
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Building  the  Objective  Function 

stage  1  Stage  2  ■  ■  -  Stage  x 


General  bridge  structure  network  for  a  single  mission 
-  Assumes  independence  of  stages  and  sensors 


Building  the  Objective  Function 
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1  (  J-  Pijk  ^ij  k  ) 

i=\ 


X  /  a  \ 

( 1  ~  ~  Pijk^ijk) 

k=i  V  i=i  / 


Probability  of  success  at 
an  individual  stage 


Probability  of  success  at 
an  individual  mission 


a 


J^(J-  Pijk^ijk^ 


i=l 


Mission  probabilities 
aggregated  into  a 
weighted-sum  scalarized 
objeetive  funetion 
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Constraining  the  Space 


a  p 

2, . . . ,  X 

i=l  j=l 


Do  not  assign  more  sensors 
than  are  available  at  a  given 
stage 


a 

Xijk  <  1  V  i  =  1,2,..,,  a,  A;  =  1, 2, ... ,  x 

Do  not  assign  a  sensor  to 
more  than  one  mission  at 
a  given  stage 
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Complete  Formulation  of  MU  SAP 


AjiR-  fdiirf  iHaTfluTE  £hr~TE£:hM3LnDV 


X 


max  Wj  I 

j=i  \fc=i 


a: 


1  ( 1  pij  k  '^ijk) 


i  =  l 


subject  to: 


a  ,»3 

X!  X!  ^  A:  =  1,  2, . . . ,  X 

i=i  j=\ 

0 

V  i  =  l,2,  .,.,Q,  A:  =  1,  2, . . . ,  X 

i=i 

J^ijk  ^  {0, 1}  V  7  =  1,2,...,  a,  j  =  1,  2, . . . ,  /i.  A: 
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4 -IT  f  DRIIC  lHliTI¥u1C  Cl#'  TEf^NMLDDt 


sensors 

missions 

stages 

number  of  points 

10 

4 

4 

1.05  X  10^ 

10 

7 

4 

2.82  X  10® 

20 

8 

4 

1.15  X  10^® 

20 

14 

4 

8.37  X  10^2 

30 

12 

4 

2.37  X  10®2 

30 

21 

4 

4.64  X  lO®*^ 

40 

16 

4 

1.46  X  10^® 

40 

28 

4 

7.70  X  10®”^ 
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Heuristic  Techniques 
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•  Construction  Heuristics 

-  Greedy  Individual  and  Greedy  Marginal 

•  Local  Search 

-  Simulated  Annealing  (with  several  parameter 
settings) 

•  Combining  Greedy  Construction  algorithms 
with  Local  search  is  a  method  called 
GRASP  (Feo  and  Resende  1989) 
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Neighborhoods 


fancc  ihKTii-uTE  or  Teenmildov 
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Experimental  Settings 


Experimental  Factors 

neighborhood 

7 

starting  point 

diversify  after 

t-' 

1-swap 

0  (Simple  Ascent) 

marginal 

50% 

2-swap 

0.9  (Simulated  Annealing) 

individual 

75% 

3-swap 

0.8  (Simulated  Annealing) 

- 

never 

0.7  (Simulated  Annealing) 

- 

- 

•  72  total  algorithms 
(3x4x2x3  =  72) 
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Full  Enumeration 
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•  Provides  a  baseline  from  comparison  of 
heuristics  techniques 

•  Generally  takes  a  large  number  of  function 
evaluations 

-  Every  point  must  be  examined 
•Not  practical  for  implementation 
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Aggregate  Results 

Diversification  Rule 

Nei  ghb  or  hoo  d 

7 

Construction 

dist 

50% 

75% 

never 

1-swp 

2-svvp 

3-swp 

0.9 

0.8 

0.7 

0 

Mrg 

Ind 

10% 

94.9% 

94.8% 

94.9% 

91.2% 

95.6% 

97.9% 

99.0% 

96.6% 

95.0% 

88.9% 

95.0% 

94.8% 

5% 

86.6% 

86.9% 

87.8% 

82.9% 

89.1% 

89.4% 

88.4% 

88.2% 

87.2% 

84.7% 

86.9% 

87.4% 

1% 

12.9% 

14.2% 

17.4% 

16.1% 

17.8% 

10.6% 

9.8% 

14.0% 

15.3% 

20.1% 

13.5% 

16.1% 

Table  B.3  Aggregate  results  for  problem  size  10x4x4 


Aggregate  Results 

Diversification  Rule 

Neighborhood 

7 

Cons  true  tion 

dist 

50% 

75% 

never 

1-swp 

2-sw'p 

3-sw'p 

0*9 

0*8 

0*7 

0 

Mrg 

Ind 

10% 

7.1% 

7.3% 

7.4% 

3.8% 

8.2% 

9.7% 

9.6% 

5.0% 

3.4% 

10.9% 

6.7% 

7.7% 

5% 

0.4% 

0.4% 

0.5% 

0.1% 

0.5% 

0.6% 

0.5% 

0.2% 

0.2% 

0.8% 

0.3% 

0.5% 

1% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

0.0% 

Table  B.5  Aggregate  results  for  problem  size  10x7x4 


Sensor  sparse  networks  have  much  worse  results 
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Initial  Results 
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•  10  X  4  X  4  network  does  well 

•  10  X  7  X  4  network  does  poorly 

-  Even  with  7x  the  iterations 

•  Re-evaluating  the  SA  algorithm 

-  If  the  last  sensor  is  removed  from  any  individual  mission’s  stage, 
the  mission  fails 

-  A  failed  mission  is  very  difficult  to  recover  to  a  successful  stage 

-  Many  local  optima  are  created 

-  Move  evident  in  “sparse”  vs.  “saturated”  networks 

•  Modification  prevents  ‘‘auto-fails”  the  every  mission  and 
stage  has  at  least  one  sensor 

-  This  eliminates  the  “greedy  individual  constructions” 

-  Only  36  algorithms  to  consider 
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Modified  Aigorithm 


Aggregate  Results 

Diversification  Rule 

Neighborhood 

7 

dist 

50% 

75% 

never 

1-swp 

2-.swp 

3-swp 

0.9 

0.8 

0.7 

0 

10% 

90.6% 

99.7% 

99.7% 

99.3% 

99.9% 

99.8%. 

99.6% 

99.6% 

99.7% 

99.7% 

5% 

91.1% 

91,6% 

92.2% 

89.7% 

93.5% 

91,7%. 

89.7% 

90,.5%. 

91.8% 

94.5% 

1% 

12.2% 

14,2% 

17.1% 

15.7% 

18.2% 

9.7% 

9.9% 

14.7% 

16.1% 

17.3% 

Tal:)le  B.7  Aggregate  results  for  prolDleiii  size  10x4x4:  Algorithm  Modilicatioii 


Aggregate  Results 

Diversification  Rule 

Neighborhood 

7 

dist 

50% 

75% 

1 

1-swp  1 

1 

3-swp 

0.8 

0,7 

0 

10% 

5% 

1% 

60,5% 

21.5% 

0S% 

60.2%  i 

21.7%  ( 
0.8%  ^ 

reijm 

24.4%) 

Kii22y 

47.8%  J 

16.3%  1 
0.-5%  1 

31.2%) 

63,1%  i 
20.0%  1 
0.-5%  ^ 

'63.9^ 

23.4%) 

60.7% 

21.9% 

0.7% 

60.0% 

22.2% 

0.8% 

.58.0% 

22.5% 

1.1% 

Table  B.9  Aggregate  results  for  ])rol;)leiii  size  10x7x4:  Algorithm  Modification 
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1 0x4x4  Network  1 0x7x4  Network 
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Overall  Heuristics  Observations 
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•  Algorithm  Type  and  Cooling  Schedule 

-  SA  with  a  cooling  schedule  of  0.9  produces  the  highest 
quality  results  only  in  the  sparse  networks 

-  In  saturated  networks,  the  Simple  Ascent  algorithm  is 
more  effective  at  returning  high  quality  solutions. 

-  May  be  because  sensor  saturated  networks  have  far  less 
local  optimal  than  the  sensor  sparse  networks 


26 


Overall  Heuristics  Observations 
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•  Neighborhood  Functions 

-  1-swap  and  2-swap  neighborhoods  proved  to  be  the 
best  neighborhoods  by  consistently  performing  well  in 
the  test  problems 

-  Larger  neighborhoods  performed  very  poorly, 
especially  in  the  larger  problem  sizes 

-  In  the  larger  neighborhoods,  there  are  many  different 
points  to  search  with  higher  n-swap  neighborhoods 
such  that  the  probability  of  finding  improving  moves  is 
smaller 

-  In  this  case,  the  simpler  methods  are  better. 
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Overall  Heuristics  Observations 
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•  Diversification  Rules 

-  “Never  diversify”  is  the  best  rule 

-  Implication  for  MUSAP  is  that  starting  off  with  a 
strategy  and  utilizing  it  throughout,  the  algorithm 
performs  much  better  than  attempting  to  switch 
midstream. 

-  Does  not  rule  out  the  possibility  of  using  a  different 
type  of  diversification  strategy  that  doesn't  use  the 
"switch  after  certain  percentage  of  iterations"  rule. 
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Conclusions 
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•  This  research  has  formulated  the 
USSTRATCOM's  sensor  assignment  problem  as  a 
type  of  resource  allocation  problem. 

-  Shown  the  utility  of  simulated  annealing  and  simple 
ascent  (iterative  improvement)  to  solve  that 
formulation. 

-  As  the  problems  became  more  complex,  simulated 
annealing  with  geometric  cooling  schedules  emerged  as 
the  most  effective  algorithm 
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Recommended  Future 


•  Inserting  Dependant  Probabilities 

-  Another  effort  has  created  this  function 

•  Simulated  Annealing  Parameter  Specification 

-  1  Ox  outer  loop  /  inner  loop  ratio  could  be  changed 

•  Varying  Weights 

-  Mission  Drop  thresholds 

•  Other  Heuristics  Techniques 

-  GA  has  been  successful  in  the  single  variable  case 
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